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APPARATUS, METHOD, AND PROGRAM FOR RECORDING IMAGES 

BACKGROUND OF THE INVENTION 
Field of t he invent-iftr, 
S The present invention relates to an apparatus and a 

method for recording image data sets obtained by a digital 
camera or by reading images recorded on a roll of film in a 
portable recording medium such as a CD-R and a DVD-R. The 
present invention also relates to a program that causes a 
IQ computer to execute the image recording method. 

Descript ion of the Related Art- 
There has been proposed a photograph service system 
regarding image data sets obtained by a digital camera or by 
reading images recorded on a negative film with a reading device 
16 such as a scanner. Such image data sets are printed or recorded 
in a portable recording medium such as a CD-R and a DVD-R (see 
U.S. Patent Laid-open No. 20010019430) . m such a photograph 
service system, a DPS store that provides a photograph service 
reads all images from a negative film whose development and 
printing was requested by a user, and image data sets obtained 
in this manner are recorded in a recording medium. 
Alternatively, the DPE store reads all image data sets obtained 
by a digital camera from a memory card, and records the image 
data sets in a recording medium. Therefore, the recording 
25 medium wherein the image data sets are recorded can be provided 
to the user for a comparatively low service charge. 
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Furthermore, by authoring the image data sets, the image data 
sets can be recorded in a recording i»ediuni in a video CD format 
or a DVD video format that enables reproduction of the image 
data sets as a slide show, for example, in this manner, the 
5 user can enjoy the slide show using the images he/she 
Photographed, by simply setting the recording medium received 
from the DPe store in a reproduction apparatus such as a 
personal computer or a DVD player. 

However, in the photograph service system described 
10 above, all the images recorded on the roll of film or all the 
image data sets recorded in the memory card are stored in the 
recording medium. Therefore, even if some of the images are 
personal, blurry, or represent the user closing his/her eyes, 
the images are also shown especially in the case of the slide 
15 show With his/her friends although the user does not wish to 
Show the images to the friends. For this reason, the negative 
film that has been developed may be provided to the user in 
advance so that the user can make selection from the film. Only 
the selected images are then read and recorded in a recording 
20 medium. Alternatively, only images selected by the user in 
advance may be recorded in the memory card to be provided to 
the DPE store. However, image selection is a troublesome 
operation for the user, and selective image reading from the 
film is also a time-consuming operation for the DPE store. 
25 Consequently, productivity of the operation for recording 
image data sets in a recording medium becomes low, which leads 
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to a higher charge of the service for image data recording in 
a recording medium. 

SUMMARY OF THE INVENTION 
Ihe present invention has been conceived based on 
5 consideration of the above circumstances. An object of the 
present invention is therefore to record image data sets m 
a recording medium by easily carrying out classification and 
selection thereon. 

An image recording apparatus of the present invention 
10 comprises: 

image acquisition means for obtaining image data sets; 
classification selection means for carrying out 
classification and/or selection on the image data sets; and 
media recording means for recording the image data sets 
15 that have been subjected to the classification and/or the 
selection in a portable recording medium. 

The image data sets can be obtained by reading images 
recorded on a roll of film or by reading prints . Alternatively, 
a memory card storing image data sets obtained by a digital 
20 camera may be read to obtain the image data sets . Hereinafter, 
a roll of film, prints, a memory card, or the like from which 
the image data sets are obtained is called a «source". The 
image data sets may be obtained from a single source such as 
a memory card alone, or from a plurality of sourcfes such as 
25 a memory card and a roll of film, or a plurality of rolls of 
film. 
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A roll of film refers to a negative fila or a reversal 
film that haa been developed, or a developed APS film having 
a magnetic component such as a magnetic strip or layer that 
enables magnetic information storage, for example. 
5 Theportable recording medium used by the image recording 

apparatus refers to a recording medium corresponding , to 
various recording methods (such as a method using 
semiconductors, magnetic recording, and optical recording), 
as long as the recording medium can record the image data sets 
10 therein and can be carried. For example, the portable 
recording medium can be a CD-R, a DVD-R, a DVD-RAM, an FD, an 
MO disc, or a memory card. 

The Classification on the imag^ data sets refers to 
grouping the image data sets according to a classification 
condition that has been predetawained. More specifically, the " 
Image data sets can be classified according to the 
classification condition such as date of photography, 
photography location, and characteristic of scenes 
represented by the image data sets. 

in the case where the image data sets are classified 
according to date of photography, information on the date of 
photography is necessary. If the image data sets are obtained 
by reading images recorded on a roll of APS film that has a 
magnetic component for recording magnetic Information, the 
infoimation on the date of photography is recorded in the 
magnetic coit«>onent and can be used for the classification. For 
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an ordinary 135-film or prints, the date of photography ia 
recorded at the time of photography. Therefore, by carrying 
out Character recognition on the date of photography recorded 
in the images or the prints, the information can be obtained, 
in the case of image data sets obtained by a digital camera, 
tag information includes the information on the date, of 
Photography, which can be used for the classification of the 
image data sets. 

As a method of the image classification according to 
scene characteristic, colors of the images, density 
distribution therein, or a shape of a subject therein are 
analyzed. Thereafter, the images whose scene characteristic 
is similar can be grouped together. • 

The image data sets maybe classified in a stepwise manner 
IS according to a plurality of conditions. Por example, if the 
date of photography and the scene characteristic are used as 
the conditions, the image data sets are classified first 
according to the date of photography. Thereafter, the image 
data sets classified according to the date of photography are 
20 further classified according to the scene characteristic. 

The selection on the image data sets refers to selection 
of a preferred portion of the image data sets. More 
specifically, a portion of the image data sets representing 
no blur and a person or persons whose eyes are not closed may 
25 be selected, for example. 

If the classification is carried cut in addition to the 
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selection, the image data sets maybe subjected to the selection 
first and then subjected to the classification, or viae versa. 

The image recording apparatus of the present invention 
may further comprise reception means for receiving an 
5 instruction to carry out further classification and/or further 
selection on the image data sets that have been subjected, to 
the classification and/or the selection and for carrying out 
the further classification and/or the further selection, m 
this case, the media recording means may record in the recording 
10 medium the image data sets that have been subjected to the 
further classification and/or the further selection by the 
reception means. 

The reception means can be any means that enables 
reception of an instruction to carry out the further 
15 classification and/or the further selection from the user who 
requested recording of the image data seta in the recording 
medium with use of an apparatus accessible to the image data 
sets that have been classified and/or selected. More 
specifically, the reception means may be a Web server that 
20 receives the further classification and/or selection 
instruction from the user using a personal computer or a mobile 
terminal such as a cellular phone or a PDA. The user can also 
input the further classification and/or selection Instruction 
on the image data sets by using a reception machine installed 
25 in a DPK store that manages an image storage server, m this 
case, the image storage server can be used as the reception 
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means, since the image storage server is directly connected 
to the reception machine. 

In the image recording apparatus of the present invention, 
the media recording means may record the image data seta that 
have been subjected to the classification and/or the selection 
in the recording medium in a format that enables display of 
a slide show. 

The format that enables display of a slide show refers 
to a format that enables serial reproduction of the image data 
sets in the recording medium by setting the recording medium 
in a personal computer, a DVD player, or the like . For example, 
the format refers to a video CD format or a DVD video format, 
depending on the recording medium wherein the image data sets 
are stored. 

In the image recording apparatus of the present invention, 
the media recording means may record in the recording medium 
the image data sets having been subjected to the classification 
and/or the selection in a manner that enables printing thereof. 

Recording the image data sets in a manner that enables 
printing thereof refers to recording the image data sets in 
the recording medium at a high resolution that enables printing 
of the images in high quality. 

An image recording method of the present invention 
comprises the steps of: 
25 obtaining image data sets; 

carrying out classification and/or selection on the 
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image data sets; and 

recording the image data seta that have been subjected 
to the Classification and/or the selection in a portable 
recording medium, 

5 The image recording method of the present invention may 

be provided as a program that causes a computer to execute.the 
method. 

According to the present invention, the image data sets 
are recorded in the recording medium after being subjected to 
10 the classification and/or the selection, without troubling the 
user or the DPE store. Furthermore, the user does not show 
all the images if only the image data seta that have been 
classified and/or selected are reproduced. 

By receiving the instruction to carry out the further 
classification and/or the further selection on the image data 
sets that have been classified and/or selected, the image data 
sets can be classified and/or selected as the user wishes. In 
this manner, the image data sets can be recorded in the 
recording medium while reflecting an intension of the user. 

Furthermore, by recording the image data sets in the 
recording medium in the format that enables display of a slide 
Show, the user can enjoy the slide show by simply inserting 
the recording medium in a reproduction apparatus such as a 
personal computer or a DVD player. 

in addition, by recording the image data sets that have 
been classified and/or selected in the recording medium in the 



15 



8 



2004$ 3^188 mm YANA6IDA&ASS0CIATES 



NO. 484" " P. 14 



25 



manner that enables printing thereof, the user can print the 
image data sets for appreciation thereof. 

BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a block diagram showing a oonfiguration of 
5 a Photograph . service system adopting an image recording 
apparatus of a first embodiment of the present invention; 

Figure 2 shows how image data sets are classified 
according to date of photography; 

Figure 3 shows an image having the date of photography 
10 recorded in a predetermined area; 

Figures 4A to 4C are diagrams showing results of 
classification and selection displayed on a terminal of a user; 

Figure 5 is a diagram showing a structure of files in 
a recording medium; 

Figure 6 is a flow chart showing a procedure carried out 
in the first embodiment; 

Figure 7 is a diagram explaining how image data sets 
obtained from a plurality of sources are classified and 
Selected; 

Figure 8 is a database having file names of the image 
data sets classified in folders; 

Figure 9 ia a block diagram showing a configuration of 
a photograph service system adopting an image recording 
apparatus of a second embodiment of the present invention; and 
Figure 10 is a diagram showing a result of classification 
and selection of iraage data sets displayed on a reception 
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machine in a store in the second embodioient . 

DESCRIPTION OP THE PREFERRED EMBODIMENTS 
Hereinafter, eitODodiments of the present invention will 
be explained with reference to the acco««,anying drawings. 
Figure 1 is a block diagram showing a configuration of a 
photograph service system adopting an image recording 
apparatus of a first einbodiment of the present Invention. As 
shown in Figure 1, the photograph service system in the first 
embodiment is provided by a DPE store 1, The photograph 
service system coniprises a film developing machine 11 for 
developing a negative film NO whose development and printing 
is requested by a user from the DPE store 1, a digital 
mini-laboratory 12 for obtaining image data sets Si (i=i~n) 
by reading images recorded on a developed negative film ni or 
15 prints a reception machine 13 installed in the DPE store 
1 for reading the image data sets Si from a memory card 30 used 
for Photography by a digital camera, an image organizing server 

14 for classifying the image data sets Si and selecting which 
of the image data sets si are to be recorded in a recording 
medium M such as a CD-R or a dvd-r, an image storage server 

15 for storing the image data sets Si for each user and for 
each order, a Web server 16 connected to the Internet 2, and 
a media drive 17 for recording the image data sets Si that have 
been classified and selected by the image organizing server 

25 14 In the recording meditom M. 

The image organizing server 14 corresponds to 
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. classification selection means while the aiedia drive 17 acts 
as media recording ineana. The Web server 16 and the iaiage 
storage server 15 correspond to reception means while the 
reception machine 13 acts as image acquisition means. 
S The digital mini-laboratory 12 coBtprises a scanner 12A 

(corresponding to image acquisition means) for obtaining.the 
image data sets Si by reading the images recorded on the 
developed negative film Nl or the prints and a printer 12B 
for obtaining prints by printing the image data sets Si. The 
10 digital mini-laboratory 12 issues an order ID and a user ID 
When an order is placed for recording in the recording medium 
M the image data sets that are obtained from the prints P or 
from the film NO to be developed and printed, or obtained by 
a digital camera. The digital mini -laboratory 12 prints the 
IS order ID and the user ID on paper by using the printer 12B, 
and the paper is provided to the user who placed the order. 
The user is also provided with a user ID card that magnetically 
stores the user id. The user accesses the Web server 16 of 
the DPE store 1 via the Internet 2 by using the terminal 3 such 
20 as a personal computer, a cellular phone, or a PDA of his/her 
own, and inputs the user ID and the order ID from the terminal 
3 to the Web server 16. In this manner, the user can view the 
image data sets Si with use of the terminal 3. m response 
to the input of the user ID and the order ID by the user from 
25 the terminal 3 to the Web server 16, the image storage server 
15 reads the image data sets si corresponding to the user ID 
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and the order ID, and inputs the image data seta si to the image 
organizing server 14. 

As has been described above, the inage organizing server 
14 carries out the classification and the selection on the image 
5 data sets si. The classification will be explained first. 

The image organizing server 14 classifies the image data 
sets Si according to date of photography thereof. For example, 
if the negative film NO whose development and printing was 
requested by the user has 24 images, 24 image data seta S1^S24 
10 are obtained. As shown in Figure 2, if the date of photography 
thereof ranges from February il to 13 of 2003, the image data 
sets S1-.S24 are classified into 3 groups according to the date 
of photography. 

The images recorded on the negative film Nl includes the 
date of photography recorded in a predetermined area in the 
lower right corner thereof, as shown in Figure 3. Therefore, 
by carrying out character recognition on the predetermined 
area in the images represented by the image data sets S1-S24, 
information on the date of photography can be obtained. In 
the case where the negative film Nl is a so-^caZled APS film 
having a magnetic component such as a magnetic strip or layer 
that can record magnetic information, the information on the 
date Of Photography is recorded in the magnetic coa«,onent and 
read magnetically for the classification. 

The prints P also have the date of photography recorded 
in a predetermined area in the lower right corner thereof, as 
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in the case of the Images recorded on the negative film Ni. 
Therefore, the information on the date of photography can also 
be obtained by carrying out character recognition on the 
predetermined area, in the case where the i»age data sets Si 
. have been obtained by a digital camera, the information on the 
date of Photography is included in tag information. Therefore, 
the information can be used as it is for the classification. 

The image data sets Si may be classified into groups of 
similar scenes by analyzing scene characteristics such as 
colors, density distribution, and a shape of a subject, for 
example. The image data sets si may also be classified 
according to human sub j ect in the images by carrying out sub j ect 
recognition on the images. 

There has been proposed a digital camera having a GPS 
function and enabling recording of the latitude and the 
longitude of a photography location as photography location 
information in tag information of an image data set . Therefore, 
the image data sets si obtained by such a digital camera may 
be classified according to the photography location, with 
reference to the photography location information. 

The image organizing server 14 selects the image data 
sets to be recorded in the recording medium M from the image 
data sets that have been classified, according to 
predetermined selection conditions. More specifically, in 
the case where the images represented by the image data sets 
Si are images of scenery, the selection conditions refer to 



13 



20'04$ 3fl18B IS^OIil YANA6IDA&ASS0CIATES "NO. 484 ' "P. 1 



a degree of underexposure/overexposure (Including appropriate 
exposure), a degree of blur (including no blur) , and a degree 
of camera shake (including no shake, . Depending on the number 
Of the image data sets Si in each of the groups, a level of 
5 selection (that is, the degrees of underexposure/overexposure, 
blur, and camera shake) is set higher if the number is larger. 
In the case of human images, the selection conditions include 
presence of blur around a face and a degree thereof, and 
presence of closed eyes, in addition to the selection 
10 conditions for scenery. since how a face looks is most 
important in the case of human images, the degree of blur around 
a face and presence of closed eyes may be used solely as the 
selection conditions. 

in the case where the number of the image data sets is 
15 one for one of the groups, the image data set is selected. 
Otherwise, it is judged first whether each of the image data 
sets in the group represents scenery or a human image, m the 
case Of scenery, the degrees of under exposure/over exposure, 
blur, and camera shake are judged by analyzing the respective 
20 image data sets in the group. The image data sets are then 
subjected to the selection according to the selection 
conditions set in accordance with the number of the image data 
sets in the group, in the case of human images, the image data 
sets are selected according to the degree of blur around a face 
2S and presence of closed eyes, i„ addition to the selection 
conditions for scenery. 
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Methods of finding the degrees of 
underexposure/overexposure, blur, and camera shake, and 
methods Of face extraction and closed-eye detection are not 
limited to specif ic methods, and any known methods can be used. 
' For example, in order to find the degree of blur, a method 
described in Japanese Patent Publication No. 3 (1991) ~76449,can 
be used. More specifically, contrasts of an entire image and 
local areas therein are found. A quantity determined by 
frequency distribution of the local contrasts is used as a first 
characteristic quantity while the contrast of the entire image 
is used as a second characteristic quantity. m a 
characteristic space determined by the first and second 
Characteristic quantities, areas of blurry images and clear 
images are empirically found, and a boundary separating the 
two areas is determined in advance. When the degree of blur 
is actually found for each of the images represented by the 
image data sets, the first and second characteristics thereof 
are found and plot in the characteristic space. By judging 
the position of the coordinates of the characteristic 
quantities in the space relative to the boundary, the 
corresponding image can be judged to be blurry or not blurry, 
in the case of a blurry image, the degree can be found according 
to how far the coordinates are from the boundary, instead of 
the entire image, a portion of the image representing a main 
subject (such as the center thereof in many cases) may be used 
for judgment of blur. 
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in the case of human Usages, a face area is extracted. 
By applying the method described above to the face area, whether 
the face area is blurry or not can be detected. For a blurry 
face, the degree of blur can also be detected. For face area 
5 extraction, a method described in Japanese Unexamined Patent 
Publication NO. 2000-48184 may be ueed, for example. More 
specifically, pre-processing such as pixel thinning and 
brightness adjustment is carried out on each of the human images 
for face area extraction. Pixels of skin color are then 
10 extracted from the pre-processed image. Distribution of 
projection of the sJcln-^color pixels is then found, and a 
skin-color area that is characteristic to a face is detected 
according to a shape of the distribution, in this manner, a 
face area candidate is found, and the face area candidate is 
LS judged to be an area of face or non-face object according to 
a predetermined method using a neural network, for example. 

For detecting closed eyes, a method of extracting eye 
areas for detecting red eyes can be used. For example, an area 
including eyea (specified either manually or automatically) 
is out from the corresponding image, and a brightness histogram 
is generated for the area. A low brightness area is extracted 
from the histogram, and areas of eyes are extracted by trimming 
the low brightness area. Presence of closed eyes can be judged 
based on a size (including 0) of the eye areas. 

The image storage server 15 stores the image data sets 
Si Obtained by the digital mini -laboratory 12 according to the 
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user ID and the order id. The image storage server IS reads 
the image data sets Si upon necessity, and sends the image data 
sets Si to the reception machine 13 or the Web server 16, 

The Web server 16 is connected to the Internet 2 and 
accessible from the terminal 3. when the user inputs the user 
ID and the order ID from the terminal 3, the Web server 16 reads 
the image data sets Si corresponding to the user ID and the 
order ID from the image storage server IS, and generates a list 
of thumbnail images . The Web server 16 sends the list and the 
image data sets selected from the thumbnail images to the 
terminal 3. 

The Web server 16 displays a result of the classification 
and the selection carried out by the image organizing server 
14 on the terminal 3. Figures 4(a) to 4(c) show the result 
IS displayed on the terminal 3. As shown in Figure 4A, folders 
(added with names such as 1, 2, and 3) for the image data sets 
that have been classified are displayed first on the terminal 
3. By opening any one of the folders, folders for the image 
data sets therein that are selected and not selected are 
20 displayed, as shown in Figure 4B. The folders have names such 
as ^Selected" and ^Not_Selected". 

When the user opens either one of the folders, a list 
of the thumbnail images of the image data sets therein is 
displayed, as shown in Figure 4C. The user can open any onfe 
as of the folders for correcting the result of the classification 
and the selection. More specifically, the user can correct 
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the result by dragging and dropping the thumbnail image or 
images as he/ehe wishes. 

The user can also display the result of the 
Classification and the selection on the reception machine X3 
by accessing the image storage server IS from the reception 
machine 13 through an input of the user id and the order.lD. 
in this case, the same screen as on the terminal 3 is displayed 
on a monitor (not shown) of the reception machine 13, whereby 
the user can confirm the result of the classification and the 
selection. The user can also correct the result as he/she 
wishes. The reception machine 13 may be equipped with a user 
ID card reader. Being read from the user ID card, the user 
ID is input to the reception machine 13. 

When the user instructs the Web server 16 to record the 
16 image data sets in the recording medium M from the terminal 
3 after correcting the result of the classification and the 
selection, the media drive 17 records the image data sets that 
have been classified and selected in the recording medium M. 
More specifically, a folder is generated for each of the groups 
20 in the recording medium M and the image data sets that have 
been selected are stored therein. 

The media drive 17 converts and records the image data 
sets in the folders according to a video CD format or a DVD 
Video format (depending on the type of the recording medium 
25 M) that enables reproduction of a slide show. The media drive 
17 also records the image data sets at a high resolution in 
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the recording medium M for enabling the user to print the irttage 
data sets with his/her printer. 

Therefore, in a file structure of the image data sets 
in the recording medium M shovm in Figure 5, each of the folders 
5 has a file having info«aation on the content of the slide show 
(a file named -userl.dat") therein and the high-resolution 
image data sets (such as 001. jpg, 002.jpg m Figure 5) 
classified into the folder, m the case where the image data 
sets enabling the slide show in the video CD format or the DVD 
10 video format are recorded in the recording medium M, the file 
having the information on the content of the slide show enabling 
reproduction of only the image data sets that have been selected 
is recorded in the recording medium M according to the format. 
The image data sets are given the file names in order of 
15 Photography. If the date of photography is the same, the order 
Of image reading from the negative filmNl is used for the file 



names < 



The user may choose whether or not the conversion for 
enabling slide-show display is carried out. in this case, the 
20 user is asked about whether or not the conversion into the 
Slide-show reproduction format is carried out when the images 
are displayed on the terminal 3 or the reception machine 13. 

m some cases, the same image data set is classified into 
a Plurality of groups, in this case, the same image data set 
25 may be stored in each of the corresponding folders. However, 
only one of the folders may have the image data set and the 
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Other folder or folders have only Unk information thereto, 
in this manner, a free space in the recording medium m can be 
saved Without storing the same image data set in all the 
corresponding folders. 
5 A procedure carried out in the first embodiment will be 

explained next . Figure 6 is a flow chart showing the procedure . 
The user has requested development and printing of the negative 
film NO from the DPS store 1, ^nd the images are displayed on 
the terminal 3 of the user when the user accesses the Web server 
10 16 from the terminal 3 . The film developing machine H of the 
DPE store 1 develops the negative film NO, and obtains the 
negative film Nl that has been developed (Step. si). The 
scanner 12A of the digital mini-laboratory 12 reads the images 
recorded thereon, and obtains the image data sets si 
IS representing the images (Step S2) . The image data sets si are 
input to the printer 12B where the prints are generated by 
printing the image data sets si (step S3) . 

The image data sets Si are sent to the image storage 
server 15 in relation to the user id and the order ID, and the 
?0 image storage server 15 stores the image data sets Si (step 
34) . The web server 16 then starts monitoring whether or not 
the user has input an instruction to display the image data 
sets Si from the terminal 3 (step S5) . if a result at Step 
S5 ie affirmative, the image organising server 14 reads the 
Image data sets Si corresponding to the user ID and the order 
ID (Step S6), and carries out the classification and the 
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selection (Step S7} , 

The Web server 16 displays the result of the 
clessifleetlon and the selection on the terminal 3 (step S8) . 
The ueer corrects the result of the classification and the 
i selection if necessary, while viewing the result displayed on 
the terminal 3. The Web server 16 judges whether or not .the 
user has input an instruction to correct the result (step S9) , 
and corrects the result (step SIO) if a result at Step S9 is 
affirmative. The Web server 16 starts monitoring whether or 
not the user has input an instruction to record the image data 
sets in the recording medium M (step Sll) . if a result at Step 
SIX is affirmative, the image data sets Si that have been 
classified and selected are recorded in the recording medium 
M (Step S12) to end the procedure, if the result at step S9 
is negative, the procedure goes to step Sll. if the result 
at Step Sll is negative, the procedure returns to Step S9, The 
recording medium M storing the image data sets Si is provided 
to the user. 

AS has been described above, according to the first 
embodiment, the image data sets si obtained by image reading 
from the negative filmNl are classified and selected, and then 
recorded in the recording medium M. Therefore, the image data 
sets Si having been classified and selected can be recorded 
in the recording medium M without causing a trouble on the DPE 
store 1 or the user. Furthermore, by reproducing the image 
data sets only in one of the groups, the user does not need 
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to show ali the image data sets to others. 

By enabling the user to further classify and select the 
image data sets that have been classified and selected, the 
Image data sets can be classified and selected as the user 
S wishes . Therefore, the image data sets can be recorded in the 
recording medium M while reflecting an intension of the user. 

By recording in the recording medium M the image data 
sets that have been classified and selected for display of the 
slide show, the user can enjoy the slide show by simply setting 
10 the recording medium M in a reproduction apparatus such as the 
terminal 3 or a DVD player. 

Moreover, by recording the image data sets that have been 
classified and selected in the recording medium M for printing 
at high resolution, the user can appreciate the images 
15 represented by the image data sets in the recording medium M 
by printing thereof. 

in the first embodiment described above, the images are 
read from the negative filza Nl and classified and selected, 
in the case where the user requests development and printing 
20 Of a plurality of negative films NO, image data sets are 
obtained by reading images from each of negative films Nl that 
have been developed. Thereafter, all the image data sets 
Obtained from all the negative films Nl may collectively be 
subjected to the classification and the selection, in this 
25 case, some of the image data sets obtained from some of the 
negative films Nl may be classified into the same group. 
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in the above e«bodii«ent, the iiaaga data sets Si may be 
Obtained from not only one source but also a plurality of 
sources (such as the negative film Nl, the prints and the 
memory card 30, to be classified and selected in the same manner. 
In this case, the user notifies the dpe store 1 of his/her 
intension to collectively deal with all the image data sets 
from all the sources in one order when the user requests 
development and printing, recording of the image data sets read 
from the prints P in the recording medium M, and recording of 
the image data sets read from the memory card 30 in the recording 
medium for example, m this manner, the same order id is 
issued for the order requesting the development and printing, 
the recording of the image data sets read from the prints P 
in the recording medium M, and the recording of the image data 
sets read from the memory card 30 in the recording medium M. 
Hereinafter, how image data sets Si obtained from a plurality 
Of sources are classified and selected will be explained next. 

Figure 7 is a diagram explaining classification and 
selection of image data sets Si obtained from a plurality of 
sources comprising 3 negative films (denoted by NU-^niS) and 
2 memory cards (referred to as BOA and 30B, . As shown in Figure 
7, the negative film Nil has 24 images (01-24) of an athletic 
contest on October 10, 2002. Image data sets obtained from 
the negative film Nil are stored in a folder Fl in the image 
25 Storage server 15. 

The negative film N12 has 12 images (01«-12, of the 
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athletic contest and 12 -laages (13^24) of a trip on October 
2S and 26, 2002. Image data sets obtained from the negative 
film N12 are stored in a folder F2 in the image storage server 
15. 

5 The negative fiim n13 has 24 ixoages (01^24) of the trip, 

and image data sets obtained from the negative film NlS.are 
stored in a folder F3 in the image storage server IS. 

The memory card 30A has 20 images (01^20) of a pet 
Photographed on October 5, 2002 . The memory card 30A also has 
10 20 images (21^40) of the athletic contest on October 10, 2002. 
image data sets obtained from the memory card 30A are stored 
in a folder F4 in the image storage server IS. 

The memory card 30B has 30 images (01^.30) of the pet 
photographed on October 20, 2000. The memory card 30B also 
IS has 10 images (31M0) of the trip on October 25 and 26, 2002, 
Image data sets obtained from the memory card 30B are stored 
in a folder FS ii, the image storage server 15. 

The image organizing server 14 carries out the 
Classification and the selection on the image data sets stored 
20 m the folders PI to FS. The selection ia carried out in the . 
same manner as in the first embodiment described above. 
Therefore, only the classification will be explained here. 
The image organizing server 14 firstly classifies the image 
data sets Si stored in the folders PI to FS according to date 
5 of photography thereof. Consequently, the image data sets Si 
are classified into the following 5 groups; 
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October 5, 2002 (pet) 
October 10, 2002 (athletic contest) 
October 20, 2002 (pet) 
October 25, 2002 (trip) 
5 October 26, 2002 (trip) . 

The image organizing server 14 further analyzes scenes 
represented by the image data sets si classified according to 
the date of photography, and groups the image data sets of the 
scenes having similar characteristics, l„ this manner, the 
10 groups of October 6 and 20 are classified into one group. The 
groups of October 25 and 26 are also grouped together. 

in this manner, the image data sets Si stored in the 
folders Fl to F5 are copied into a folder FIX storing the image 
data sets obtained on October 10, a folder P12 storing the image 
15 data sets representing the pet photographed on October S and 
20, and a folder P13 storing the image data sets of the trip 
on October 25 and 26. 

Therefore, by accessing the Web server 16 from the 
terminal 3, the user can view the images classified into the 
20 3 folders Fli to F13. The image data sets in each of the folders 
are sorted according to the date (or date and time) of 
Photography. Since only the date of photography is known for 
the images obtained from the negative films Nil to N13, the 
corresponding image data sets are sorted in order of image 
25 reading from the films Nil to N13. 

in this example, the image data sets stored in the folders 
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Fl to FS are copied Into the folders Pll to F13. However, in 
order to save storage space i„ the image storage server IS, 
only link information to the i«age data sets Si is preferably 
stored in each of the folders Fll to P13. Alternatively, as 
5 shown in Figure 8, a database storing file names (such as 001, 
002, 101, 102, 201, and 202) of the image data sets classified 
m each of the folders Fll to F13 may be generated so that the 
image data sets Si can be viewed with reference to the database 
instead of actually storing the image data sets or the link 
10 information in the folders Fll to F13. 

in the first embodiment described above, the user may 
receive some images from his/her friend and wish to include 
the images in the groups after the image data sets have already 
been recorded in the recording medium M. In this case, the 
user can add new image data sets representing the images he/she 
received to the image data sets stored in the recording medium 
M. Hereinafter, this case will be explained as a second 
embodiment of the present invention. 

Figure 9 is a block diagram showing a configiiration of 
3 Photograph service systeih adopting an image recording 
apparatus of the second embodiment . In the second embodiment, 
the same elements as in the first embodiment have the same 
reference numbers, and detailed explanations thereof will be 
omitted, in the second embodiment, a reception machine 23 is 
installed in the DPE5 store 1 and equipped with a media drive 
that can read and write information from and in the recording 
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medium M. 

The user has placed an order (hereinafter referred to 
as the latest order) for film development and printing, 
recording image data sets read from prints P in the recording 
S mediumM, and/or recording image data sets obtained by a digital 
camera in the recording medium M. The image storage se^sver 
15 already stores the image data sets classified and selected 
in the latest order and in the past order. 

The user causes the reception machine 23 to read the user 
ID from the user ID card, in this manner, the user ID is input 
to the reception machine 23. The user also inputs the order 
IDs of the latest order and the past order for display of the 
image data sets stored in the image storage server 15 on the 
reception machine 23 . m this manner, on the reception machine 
IS 23 are displayed the folders 1, 2, and 3 classified in the past 
order and folders 4 and 5 classified in the latest order, as 
. Shown in Figure lo. The user selects any one of the folders 
as he/she wishes, and displays the list of the thumbnail images 
of the image data sets classified in the selected folder, as 
20 in the first embodiment. 

After the user confirms the content of the image data 
sets classified and selected into the folder,' the user can drag ' 
and drop any one of the folders (such as the folder 4) in the 
latest order or a thumbnail image or thumbnail images therein 
to one of the folders (such as folder 1) m the past order. 
In this manner, the user can include any one of the image data 
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sets in the latest order in any one of the groupa of the image 
data sets in the past order. 

in Bome cases, the image storage server IS way not store 
the image data sets in the past order anymore due to expiration 
5 Of storage period thereof, m this case, the user inserts the 
recording medium M in the reception machine 23, and causes. the 
reception machine 23 to read the image data sets that have been 
Classified and selected in the recording medium M. In this 
manner, the user can temporarily store the image data sets in 
10 the past order again in the image storage server 15. 

Whan the user instructs the reception machine 23 to write 
the image data sets after the classification and the selection 
thereof, the machine 23 adds the image data sets to the image 
data sets in the past order that have been classified and 
IS selected in the recording medium M. 

In this case, the image data sets may be added in the 
video CD fomat or the DVD video fomat, as in the case of the 
first embodiment, a play list file is newly generated for 
defining reproduction order of the image data sets, and the 
20 Play list file already existing in the recording medium M is 
set inactive. The reproduction order in the play list may 
represent order of photography of the image data sets if the 
information on time and date of photography is available. 
Alternatively, the image data sets in the latest order may be 
25 reproduced after the image data seta in the past order. 

In the second embodiment, the image data sets in the 
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latest order are added to the Image data sets In the recording 
medium m. However, all Image data sets recorded in a plurality 
of recording media M may be subjected to the classification 
and the selection for newly recorded in one of the recording 
' media M or in a new recording medium M. m this case, if the 
image storage server 15 has all the image data sets from all 
the recording media the image data sets are used as they 
are for the new recording. Otherwise, the image data sets are 
read from the recording media H and stored again in the image 
storage server 15 for the classification and the selection 
thereof, as In the second embodiment. 

in the first and second embodiments described above, the 
image data sets si are subjected to the classification and the- 
selection at the same time. However, the image data sets may 
only be classified or selected to be recorded in the recording 
medium M. in the first and second embodiments, the image data 
sets Si are subjected to the classification followed by the 
selection. However, the Image data sets si may be subjected 
to the selection followed by the classification. 

In the first and second embodiments described above, the 
image storage server IS may store audio data sets so that the 
user can select some of the audio data sets to be included in 
the file used for display of the slide show, while using the 
terminal 3. 
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